Information outputting device

ABSTRACT

Recognition of a player&#39;s touch on a surface of a medium is made possible, as well as recognition of the medium such as a card by a dot pattern printed on a back surface of the medium placed on a stage. Input instructions according to each feature of a game or information processing device are made possible just by preparing a card on which a region for a touch operation is printed, by making possible recognition of a player&#39;s touch on a surface of a medium, as well as recognition of the medium such as a card by a dot pattern printed on a back surface of the medium placed on a stage, calculating where on a card placed on the stage is touched, and causing to perform a process according to a feature of the card.

TECHNICAL FIELD

The present invention relates to a medium having printed thereon a dotpattern and an information output device thereof.

BACKGROUND ART

There is known a game machine installed at a game center or the like,where a card is placed on a stage surface. The game proceeds accordingto the attributes of such card (JPA-2005-46649).

According to JPA-2005-46649, the stage surface is configured to transmitinvisible light. An imaging unit such as an image sensor disposed underthe stage reads a code of a particular shape printed on the back surfaceof the card with invisible ink, thereby causing the game to proceed.

DISCLOSURE OF THE INVENTION Problem that the Invention is to Solve

However, since the above-described game machine has a simple system ofreading a code on the back surface of a card, the game itself does nothave entertaining trait. Also, only a design of some character or thelike was printed on the front surface of the card.

The present invention was undertaken in consideration of the aboveproblems. When the present invention is used as a game device, ingenuityin designing of stage surface further promotes entertainment trait ofthe game. Meanwhile, when used as an input interface, the presentinvention provides an input control instruction system having a flexibleinterface which enables operations on a printing region of buttons andicons printed on the front surface of the card as well as on a code onthe back surface of the card.

Means for Solving the Problem

The present invention has employed the following means to solve theproblems.

According to a first aspect of the invention, there is provided aninformation output device comprising a touch panel chassis having atouch panel on at least one surface thereof, the touch panel having amedium, on which a coordinate value based on a predetermined rule and adot pattern signifying a code value are printed, placed on the touchpanel with a surface on which the dot pattern is printed facing thetouch panel, a coordinate recognition unit, disposed on a side of thetouch panel, for recognizing, as a coordinate value, a position of aplayer/operator's fingertip or a position of a pen or three dimensionalobject on the medium of the touch panel, an imaging unit for imaging thedot pattern of the medium or a portion thereof from a back surface sideof the touch panel via an imaging portion disposed on a predeterminedlocation in the touch panel chassis, a control unit for computing thecoordinate value, the code value and an orientation signified by the dotpattern based on a captured image by the imaging unit, and for inputtinga coordinate information from the coordinate recognition unit of thetouch panel, and an output unit for outputting multimedia informationsuch as a text, figure, image, motion picture, or sound informationaccording to a instruction from the control unit, wherein the controlunit calculates where on the medium a placing of the player/operator'sfingertip or a placing of the pen or three dimensional object isperformed, based on the coordinate value and code value of the dotpattern printed on the medium and the orientation of the medium,predetermined location information of the imaging portion, and thecoordinate information from the coordinate recognition unit, and thecontrol unit causes the output unit to output the multimedia informationwhich differs depending on the location on the medium calculated.

According to a second aspect of the invention, there is provided aninformation output device according to the first aspect, wherein the dotpattern printed on the medium has at least the code value, and themedium is fixed at a predetermined location and orientation on the touchpanel, wherein the control unit calculates where on the medium a placingof the player/operator's fingertip, an operation, or the threedimensional object is performed, based on the code value of the mediumand the coordinate information from the coordinate recognition unit, andthe control unit causes the output unit to output the multimediainformation which differs depending on the location on the mediumcalculated.

Further, according to a third aspect of the invention, there is providedan information output device according to the first aspect, wherein theimaging portion in the touch panel chassis is a transmissive portionwhich transmits irradiation light from an infrared irradiation unit andreflected light thereof, and at least one or two or more of thetransmissive portions are provided.

Based on these aspects, an imaging unit reads a dot pattern of a medium,enabling calculation of a location, orientation, and the like of themedium on a touch panel as well as recognizing as coordinates a positionof a player/operator's finger tip and a position of a pen operation orthree dimensional object. By arithmetically processing these values withthe values obtained based on the location and orientation of the card,for example, where on the surface of the card a placing of aplayer/operator's fingertip or pen operation is performed can berecognized. In this way, a medium (e.g., a card) can be used as your owninput interface. In addition, this will be an interface with highflexibility as the medium (card) may be placed at any location on thepanel.

Such information output device may realize an input device with acompact input interface connected to a personal computer or the like.

With regard to the medium, a card having a dot pattern printed on theback surface or a figure on which a dot pattern is printed may bepossible.

Further, the output unit includes a speaker for outputting sound as wellas a display for displaying an image and a motion picture.

According to a forth aspect of the invention, there is provided aninformation output device comprising a stage chassis having a stage onat least one surface thereof, configured to, after placing a medium, onwhich back surface a dot pattern based on a predetermined rule isprinted, on the stage with the back surface of the medium facing thesurface of the stage, read the dot pattern on the back surface of themedium placed at a certain location on the surface of the stage by animaging unit disposed in a space in the stage chassis, calculate a codevalue signified by the dot pattern, based on a captured image obtainedfrom the imaging unit, and an orientation of the medium, based on arecognition result of the dot pattern, compute a location of the mediumplaced on the surface of the stage which is defined by XY coordinates,and output information according to a computing result, wherein, on thestage, a coordinate recognition unit for recognizing a position of aplayer/operator's fingertip or a position of a pen or three dimensionalobject with respect to the medium on the stage is provided.

Based on this aspect, since nearly the whole surface of the stage can beread by an imaging unit, a large-scale input interface such as a gamefor a plurality of persons may be realized.

According to a fifth aspect of the invention, there is provided aninformation output device according to the forth aspect, wherein, on thestage, a printing with ink which transmits infrared rays is made or asheet printed with the same ink is removably attached.

Based on this aspect, printing can be made on the stage surface, whichpermits expressing a world view of a game or the like as well asfacilitates a recognition of placing location of a card or the like.

According to a sixth aspect of the invention, there is provided aninformation output device comprising a control unit for reading, after amedium on which a dot pattern based on a predetermined rule is printedis placed on a stage in a state where the dot pattern faces a surface ofthe stage, the dot pattern on a back surface of the medium placed at acertain location on the stage by an imaging unit disposed in a stagechassis, calculating a code value signified by the dot pattern, based ona captured image obtained from the imaging unit, and an orientation ofthe medium, based on a recognition result of the dot pattern, andcomputing a location of the medium placed on the surface of the stagewhich is defined by XY coordinates, and an output unit for outputtinginformation according to a computing result, wherein, on the stage, acoordinate recognition unit for recognizing a position of aplayer/operator's fingertip or a position of a pen or three dimensionalobject with respect to the medium on the stage as a coordinate value onthe stage is provided, wherein a projection unit for projecting a motionpicture or an image from a back surface side with respect to the stageis given, wherein the control unit controls the image or the motionpicture projected from the back surface side of the stage by theprojection unit, by interlocking with a placing of the player/operator'sfingertip, a touching with the pen, or a placing of the threedimensional object recognized by the coordinate recognition unit.

Based on this aspect, a motion picture projected on the stage may becontrolled by a dot pattern printed on the back surface of a medium suchas a card placed on the stage. Moreover, the motion picture can befurther modified by performing a touch operation by an operator'sfingertip or pen on the surface of the medium such as a card.

According to a seventh aspect of the invention, there is provided aninformation output device according to any one of the first to sixthaspects, further having a peripheral wall on a periphery of the surfaceof the touch panel or the stage and a notch portion on part of theperipheral wall so that a medium on the surface of the touch panel orthe stage can be retracted from the surface of the touch panel or thestage.

Based on this aspect, removing a card from a touch panel surface or astage surface may be extremely easy.

According to an eighth aspect of the invention, there is provided aninformation output device according to the seventh aspect, furtherhaving one or a plurality of infrared irradiation elements and one or aplurality of light-receiving elements adjacently disposed one afteranother to cause the touch panel or the stage to function as acoordinate recognition unit, wherein a location in an X direction or a Ydirection on the touch panel or the stage can be recognized by areception, by the light-receiving elements, of reflected light ofinfrared light irradiated from the infrared irradiation elements andreflected by a player/operator's fingertip, pen or three dimensionalobject placed on the touch panel or the stage or on the medium on thetouch panel or the stage, and a notch so that the medium on other sideof the peripheral wall or on the touch panel or the stage can beretracted from the touch panel or the stage.

Based on this aspect, a location of a fingertip or a pen operation maybe recognized even if part of a peripheral wall does not exist.

According to a ninth aspect of the invention, there is provided aninformation output device according to the seventh aspect, wherein, onsides adjacent to the one side of the peripheral wall, peripheral wallsare provided on which infrared irradiation elements or light-receivingelements are disposed respectively, and the peripheral walls enable arecognition of a location in a Y direction or an X direction on thetouch panel or the stage, based on the fact that the light-receivingelements on an opposed side do not receive infrared light as irradiatedlight irradiated from the infrared irradiation elements and blocked by aplayer/operator's fingertip, pen, or three dimensional object placed onthe touch panel or the stage or on the medium placed on the touch panelor the stage.

Based on this aspect, this touch panel is generally configured to haveone side of the peripheral wall on which one or a plurality of infraredirradiation elements and light-receiving elements are adjacentlydisposed one after another and have adjacent sides on which onlyinfrared irradiation elements or light-receiving elements are disposed.Therefore, a side opposed to the one side of the peripheral wall neednot be provided and a notch portion can be provided here.

According to a tenth aspect of the invention, there is provided aninformation output device according to the seventh aspect, wherein arecognition of XY coordinates of a player/operator's fingertip, pen, orthree dimensional object on the touch panel or the stage is madepossible by providing a pair of infrared imaging devices, which allowsthe touch panel or the stage to function as a coordinate recognitionunit, on both inner ends of one side of a peripheral wall of the touchpanel or the stage, and by having a control unit analyze images capturedby each of the infrared imaging devices, wherein at least one side ofthe peripheral wall has the notch portion so that a medium on the touchpanel or the stage can be retracted from the touch panel or the stage.

Based on this aspect, XY coordinate values of a fingertip or the like onthe touch panel or the stage are calculated using infrared imagingdevices, permitting high recognition accuracy and a provision of a notchportion on part of the peripheral wall, which does not affect thecaptured images of the infrared irradiation devices and facilitates aretraction of a card or the like from a surface of the touch panel orthe stage.

According to an eleventh aspect of the invention, there is provided aninformation output device according to any one of the first to tenthaspects, further having a peripheral wall on a periphery of the touchpanel or the stage, embedding a coordinate recognition unit of the touchpanel or the stage in the peripheral wall, and comprising a side wallcurved from the touch panel or the stage so that a medium on the touchpanel or the stage can be retracted from the touch panel or the stage.

Based on this aspect, a card or other media can be easily retracted fromthe stage surface due to a provision of a curved side wall.

According to a twelfth aspect of the invention, there is provided aninformation output device according to any one of the first to tenthaspects, further having a peripheral wall on a periphery of the touchpanel or the stage, embedding a coordinate recognition unit of the touchpanel or the stage on the peripheral wall, and providing a card loadingslot on the touch panel or the stage so that a medium can be inserted orretracted therethrough.

Based on this aspect, a card can be inserted or ejected through a cardloading slot, facilitating a retraction of the card from the touch panelwithout providing a notch portion.

Further, since the card inserted from the card loading slot is correctlypositioned on the surface of the stage or the touch panel, an XYcoordinate system on the surface of the card completely matches an XYcoordinate system recognized by the coordinate recognition unit.Therefore, a touch location on a card by a fingertip or a medium can beeasily recognized without a complicated calculation.

According to a thirteenth aspect of the invention, there is provided aninformation output device according to any one of the first to twelfthaspects, wherein a selection button of the multimedia information isdirectly printed or a sheet on which a selection button of themultimedia information is printed is removably attached on a portion ofthe touch panel or the stage, and a position of a player/operator'sfingertip, pen operation, or three dimensional object in relation to theselection button is recognized based on the coordinate information fromthe coordinate recognition unit to thereby output selected multimediainformation from an output unit.

Based on this aspect, users can be easily instructed operations byattaching in advance a sheet on which instructions indicating operationsare printed on the touch panel or the stage.

According to a fourteenth aspect of the invention, there is provided aninformation output device according to any one of the first to fifthaspects, wherein part of the touch panel or the stage is configured as adisplay portion which is able to display display information of adisplay unit provided on the touch panel or the stage.

Based on this aspect, since at least part of the touch panel or thestage constitutes a display portion, a motion picture, image, or textinformation which instructs an operation of a game can be displayed.

Moreover, as a projection unit, any display unit, for example an LDCdisplay, plasma display, or projector, may be used.

According to a fifteenth aspect of the invention, there is provided aninformation output device according any one of the first to fifthaspects, wherein a suction opening for absorbing a medium to the touchpanel or the stage is provided, and the suction opening makes the mediumin close contact with the touch panel or the stage by forming negativepressure in the suction opening.

As such, absorbing a card or other media to the stage or the touch panelby providing a suction opening allows accurate imaging of a dot pattern,preventing the card or other media from lifting or unintentionallymoving from the stage or the touch panel, even when the stage or thetouch panel is inclined. Accordingly, an information output devicecomprising a standing-type touch panel or stage can be realized.

According to a sixteenth aspect of the invention, there is provided aninformation output device according to the fifteenth aspect, wherein anegative pressure generation unit controlled by a control unit isprovided in a touch panel chassis where the touch panel is provided orin a stage chassis where the stage is provided, and the control unit,when it recognizes a location of a medium in a vicinity of the touchpanel or the stage based on a change of a captured image captured by theimaging unit, instructs the negative pressure generation unit to vacuumsuction from the suction opening.

As such, since the negative pressure generation unit (vacuum pump) isactivated by recognizing an access of a card or other media to the touchpanel or the stage, a card or other media can be more reliably absorbedto the stage or the touch panel only when necessary, and the negativepressure unit is not activated when it is not used. This results innoise reduction and power conservation, and prevents a clog in thesuction opening.

ADVANTAGE OF THE INVENTION

According to the aspects of the present invention, when used as a gamedevice, it is possible that ingenuity in designing of stage surfacefurther promotes entertainment trait of the game. Meanwhile, when usedas an input interface of a general-use computer or the like, the presentinvention is able to provide an input control instruction system havinga flexible interface which enables operations on a printing region ofbuttons and icons printed on the front surface of the card as well as ona code on the back surface of the card.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is an explanatory diagram illustrating a use state of the touchpanel chassis in an embodiment of the present invention.

FIG. 2 is a perspective view showing a modification example of the touchpanel chassis.

FIG. 3 is a block diagram of hardware in an embodiment of the presentinvention.

FIG. 4 is an explanatory diagram illustrating an arrangement of each dotin a dot pattern.

FIG. 5 is an explanatory diagram showing a dot pattern format.

FIG. 6 is an explanatory diagram showing an example of a dot pattern.

FIGS. 7A and 7B are enlarged views showing an example of a informationdot of a dot pattern.

FIGS. 8A and 8B are explanatory diagrams showing an arrangement ofinformation dots.

FIG. 9 is an example showing an information dot and a bit display ofdata defined therein and showing another embodiment.

FIGS. 10A to 10C are examples of information dots and bit displays ofdata defined therein. Particularly, FIG. 10A is a diagram of disposingtwo dots, FIG. 10B is a diagram of disposing four dots, and FIG. 10C isa diagram of disposing five dots.

FIGS. 11A to 11D are modification examples of a dot pattern.Particularly, FIG. 11A is a schematic view of a six information dotarrangement, FIG. 11B is a schematic view of a nine information dotarrangement, FIG. 11C is a schematic view of a 12 information dotarrangement, and FIG. 11D is a schematic view of a 36 information dotarrangement.

FIG. 12 is a diagram illustrating a touch panel structure.

FIGS. 13A and 13B are explanatory diagrams illustrating a method forcomputing a location of a fingertip touched by a user.

FIGS. 14A and 14B are explanatory diagrams illustrating modificationexamples of the touch panel chassis of the present invention.

FIG. 15 is another embodiment of a touch panel chassis, and aperspective view illustrating a stage-type touch panel chassis, that isa stage chassis.

FIG. 16 is a perspective view illustrating a modification example of thestage chassis.

FIGS. 17A and 17B are perspective views of an arrangement of a card,IRLED, and touch panel.

FIG. 18 is a perspective view showing a modification example of thestage chassis.

FIG. 19 is a perspective view illustrating an arrangement of a card,IRLED, and touch panel.

FIG. 20 is an explanatory diagram illustrating an arrangement of dotpatterns shown in FIGS. 22 and 23.

FIG. 21 is an explanatory diagram showing a dot pattern format.

FIG. 22 is an explanatory diagram of a dot pattern in FIGS. 7A to 12that defines a direction of a block by changing the way of arranginginformation dots.

FIG. 23 is an explanatory diagram of a dot pattern in FIGS. 7A to 12that defines a direction of a block by changing the way of arranginginformation dots, and showing an information dot arrangement.

FIGS. 24A and 24B are explanatory views illustrating a method forcomputing a location of a fingertip when touched by a user.

FIGS. 25A and 25B are perspective views illustrating a touch panelchassis having a notch portion or a curved side wall portion.

FIGS. 26A and 26B are perspective views illustrating a touch panelchassis having an insertion opening for insertion of a card.

FIG. 27 is a diagram illustrating a specific use example of a card, whenthe card is used as a membership card.

FIGS. 28A and 28B are diagrams illustrating specific use examples of acard, when the card is used as an employee ID card.

FIG. 29 is a diagram illustrating a specific use example of a card, whenthe card is used as a card for time management.

FIG. 30 is a diagram illustrating a specific use example of a card, whenthe card is used as a calculator.

FIG. 31 is a diagram illustrating a specific use example of a card, whenthe card is used as a card for movie viewing.

FIG. 32 is a diagram illustrating a specific use example of a card, whenthe card is used as a card for Web browsing.

FIGS. 33A and 33B are diagrams illustrating specific use examples of acard, when the card is used as a card for viewing 3D objects.

FIG. 34 is a diagram illustrating a specific use example of a card, whenthe card is used as a patient's registration card.

FIGS. 35A to 35C are diagrams illustrating a specific use example of acard, when the card is used a card for shopping.

FIG. 36 is a diagram illustrating a specific use example of a card, whenthe card is used as an ATM card for banking.

FIG. 37 is a diagram illustrating a specific use example of a card, whenthe card is used as an animal pictorial book card.

FIGS. 38A and 38B are diagrams illustrating specific use examples of acard, when the card is used as a controller for a movie recorder.

FIG. 39 is a diagram illustrating a specific use example of a card, whenthe card is used as a controller for a voice recorder.

FIGS. 40A and 40B are diagrams illustrating a specific use example of acard, when the card is used as a recipe card.

FIGS. 41A to 41C are diagrams illustrating a specific use example, whena medium to be placed on the touch panel is a booklet form (1).

FIG. 42 is a diagram illustrating a specific use example, when a mediumto be placed on the touch panel is a booklet form (2).

FIG. 43 is a diagram illustrating a specific use example of a card, whenthe card is used as a card for a questionnaire.

FIG. 44 is a diagram illustrating a specific use example of a card, whenthe card is used as a card for controlling a system.

FIG. 45 is a diagram illustrating a specific use example of a card, whenthe card is used as a card for playing music.

FIGS. 46A and 46B are diagrams illustrating a specific use example of acard, when the card is used in lieu of a mouse.

FIG. 47 is an explanatory diagram illustrating a modification example ofa touch panel chassis of the present invention, and a diagram showing atouch panel chassis having suction openings.

FIGS. 48A and 48B are explanatory diagrams illustrating anotherembodiment of a touch panel (1).

FIGS. 49A and 49B are explanatory diagrams illustrating anotherembodiment of a touch panel (2).

FIG. 50A is an explanatory diagram showing an order for inputtinginformation dots. FIG. 50B is an explanatory diagram showing a methodfor reading a dot pattern and computing XY coordinate values.

FIGS. 51A and 51B are explanatory diagrams showing an arrangement andformat of a dot pattern having XY coordinate values.

FIG. 52 is an explanatory diagram showing a specific example of a dotpattern having XY coordinate values.

FIGS. 53A and 53B are longitudinal cross-sectional view showing anenlarged cross section structure of a stage of a stage chassis.

DESCRIPTION OF NUMERALS AND SIGNS

-   1 DOT PATTERN-   2 KEY DOT-   3 INFORMATION DOT-   4 REFERENCE GRID POINT DOT-   5 VIRTUAL GRID POINT

BEST MODE FOR CARRYING OUT THE INVENTION

Referring to FIG. 1, a touch panel chassis, which is a feature of thepresent invention, is connected to a general-use computer system.

This system has a computer main body, a display device, and a touchpanel chassis. The upper surface of the touch panel chassis of thisembodiment is configured as a touch panel. Specifics of this system areillustrated in FIGS. 1 and 2. More specifically, a group oflight-emitting elements and a group of light-receiving elements aredisposed in pairs. When light emitted from the light-emitting elementsare blocked by a medium such as a fingertip, a touch pen, or a figure,the light supposed to be received by the light-receiving elements cannotbe received. Coordinate inputs are enabled by recognizing the existenceof such light blocking object at the corresponding location. An imagingopening opens at the center of the upper surface of the touch panel.When placed on the upper side of the imaging opening, a dot patternprinted on the back surface of a card can be captured by a cameraprovided in the chassis.

The touch panel may be other structures such as using an infraredimaging device, as shown in FIGS. 48A to 49B.

IRLEDs as lighting units are disposed around the camera in the touchpanel chassis, irradiating the imaging opening. That is, a dot patternon the back surface of a card can be captured by imaging the reflectedlight of infrared light irradiated by the IRLEDs, on the back surface ofthe card placed at the imaging opening.

For the dot pattern on the back surface of the card, further describedlater, since the dot pattern is printed with ink which absorbs infraredrays, superimposing and printing the dot pattern on normal printings donot affect an imaging of the dot pattern by the camera.

FIG. 2 shows a modification example of a touch panel chassis. Touchpanel structure is the same as those described in above FIG. 12 and FIG.48A to FIG. 49B, with exceptions that a sheet with operation buttonsprinted is attached on a surface of the touch panel and that a displayis disposed on part of the touch panel.

FIG. 3 is a block diagram of hardware in an embodiment of the presentinvention.

As shown in FIG. 3, the camera has a sensor unit, a lens and a lensholder, and an IR filter disposed at the leading end of the lens.

Further, the imaging opening of the sensor unit may be processed by amicro processing unit (MPU) and a frame buffer of the camera, or bysoftware of a central processing unit (CPU) of the computer main body.

The micro processing unit of the camera or the central processing unitof the computer main body analyzes dots from a captured dot patternimage, converts the dot pattern into codes signifying the dot pattern,reads information corresponding to the codes from memory, and outputsfrom a display or a speaker.

Such dot pattern is described in FIG. 4 to FIG. 11D.

FIG. 4 and FIG. 5 are explanatory diagrams showing a relationship amonga dot pattern, a code value, and an identifier.

The dot pattern shown in FIG. 4 is a dot pattern composed of 4×4-blockregions. These blocks are separated into C₁₋₀ to C_(31-30.) Eachregion's dot code format is shown in FIG. 5.

As shown in FIG. 5, C₀ to C₂₃ mean a data region and a company code, C₂₄and C₂₅ mean a code category, C₂₆ to C₂₉ mean a control code, and C₃₀and C₃₁ mean parity. There are four types of formats; C₂₄ and C₂₅ valuesdetermine bit numbers of a data region and a company code. That is, whenC₂₄ and C₂₅ are 00, the data region is eight bits and the company codeis 16 bits; when 01, the data region is 12 bits and the company code is12 bits; when 10, the data region is 16 bits and the company code iseight bits; when 11, the data region is 20 bits and the company code isfour bits.

Next, a dot pattern used in this invention is described using FIG. 6 toFIG. 11D.

FIG. 6 is an explanatory diagram showing an example of a dot pattern,GRID1.

In these diagrams, grid lines in horizontal and vertical directions aredrawn for convenience of explanation, and do not exist in real printingsurface. It is desirable that when the scanner as an imaging unit hasinfrared irradiation units, the dot pattern constituents, such as a keydot 2, information dot 3, and reference grid point dot 4, are printedwith invisible ink which absorbs such infrared light or with carbon ink.

FIGS. 7A and 7B are enlarged views showing an example of an informationdot of a dot pattern and a bit display of data defined therein. FIGS. 8Aand 8B are explanatory views showing information dots arranged around akey dot.

The information input/output method using the dot pattern of the presentinvention comprises a unit for generating a dot pattern 1, a unit forrecognizing the dot pattern 1, and a unit for outputting information anda program from this dot pattern 1. That is, after retrieving a dotpattern 1 as image data by a camera, first, the method extracts areference grid point dot 4, next, extracts a key dot 2 based on the factthat there is no dot at the location where a reference grid point dot 4supposed to be, extracts an information dot 3, and digitizes theinformation dot 3 to extract the information region and convert theinformation into numerical values. Based on the numerical information,information and a program are output from this dot pattern 1. Forexample, information such as a sound and a program are output, from thisdot pattern 1, on an information output device, a personal computer, aPDA, a mobile phone, or the like.

To generate the dot pattern 1 of the present invention, based on a dotcode generation algorithm, fine dots used for recognition of informationsuch as sound including a key dot 2, an information dot 3, and areference grid point dot 4 are arranged according to a predeterminedrule. As shown in FIG. 6, in a block of the dot pattern 1 whichrepresents information, 5×5-reference grid point dots 4 are arrangedwith reference to a key dot 2, and information dots 3 are arrangedaround a virtual grid point 5 which is surrounded by four reference gridpoint dots 4. Arbitrary numerical information is defined in this block.The example illustrated in FIG. 6 shows four blocks of the dot pattern 1arranged in parallel (in bold frame), provided, however, that the dotpattern 1 is not limited to four blocks.

One piece of information and a program corresponding to one block can beoutput, or one piece of information and a program corresponding to aplurality of blocks can be output.

When a camera retrieves this dot pattern 1 as image data, the referencegrid point dots 4 can correct a distortion of the lens of the camera,skewed imaging, expansion and contraction of a paper surface, curvatureof a medium surface, and distortion during printing. Specifically, afunction for calibration (Xn, Yn)=(Xn′, Yn′) is calculated to convert adistorted four reference grid point dots 4 into the original square,then the vector of the correct information dots 3 is obtained bycalibrating the information dots 3 by the same function.

If reference grid point dots 4 are arranged in the dot pattern 1, sincethe image data of this dot pattern 1 retrieved by a camera is calibratedits distortion attributable to the camera, image data of the dot pattern1 can be recognized accurately even though retrieved by a popular camerawith a lens with high distortion rate. Moreover, the dot pattern 1 canbe accurately recognized even when the dot pattern 1 is read by a camerainclined with reference to a surface of the dot pattern 1.

Key dots 2 are dots, as shown in FIG. 6, arranged by shifting fourreference grid point dots 4 which are disposed at four corners of ablock, in a certain directions. The key dot 2 is a representative pointof one block of the dot pattern 1 which represents an information dot 3.For example, key dots 2 are the dots being shifted the reference gridpoint dots 4 disposed at four corners of a block of the dot pattern 1 by0.1 mm upward. If an information dot 3 represents X, Y coordinatevalues, the coordinate points are the locations obtained by shifting thekey dots 2 by 0.1 mm downward. However, these numbers are not limited tothese, and may change depending on the size of a block of the dotpattern 1.

Information dots 3 are dots used for recognition of a variety ofinformation. The information dot 3 is arranged around a key dot 2 as arepresentative point. The information dot 3 is also disposed at theending point of a vector with the starting point being a virtual gridpoint 5 at the center surrounded by four reference grid point dots 4.For example, this information dot 3 is surrounded by four reference gridpoint dots 4. As shown in FIG. 7A, since dots 0.1 mm away from thevirtual grid point 5 have direction and length as expressed by vectors,the dots can express three bits by being disposed in eight directions byshifting by 45 degrees in clockwise direction. Therefore, one block ofthe dot pattern 1 may express 3 bits×16=48 bits.

FIG. 7B is a method of defining information dots 3 having two bits foreach grid, in the dot pattern of FIG. 6. Two bit information is eachdefined by shifting a dot in + direction and × direction. In this way,although 48 bit information can be indeed defined, data may be allocatedto each 32 bits by dividing for an intended purpose. Maximum of 2¹⁶(65,000 approx.) dot pattern formats can be realized depending on thecombination of + direction and × direction.

It should be noted that dot pattern formats are not limited to these,and may vary including a possibility of four bit expression by arrangingthe dots in 16 directions.

Preferably, the dot diameter of a key dot 2, information dot 3, orreference grid point dot 4 is approximately 0.05 mm in consideration ofvisual quality, printing accuracy in respect of a paper quality,resolution of a camera, and optimal digitalization.

Moreover, in consideration of information amount required for an imagingarea and possible false recognition of dots 2, 3, 4, distance betweenreference grid point dots 4 is preferably around 0.5 mm in both verticaland horizontal directions. Displacement of a key dot 2 is preferablyaround 20% from the grid distance, taking into account the possiblefalse recognition with reference grid point dots 4 and information dots3.

A distance between this information dot 3 and a virtual grid pointsurrounded by four reference grid point dots 4 is preferably thedistance of around 15-30% of the gap between adjacent virtual gridpoints 5. If the gap between an information dot 3 and a virtual gridpoint 5 is shorter than this distance, the dots are easily recognized asa big cluster, and are ugly as a dot pattern 1. On the other hand, ifthe gap between an information dot 3 and a virtual grid point 5 is widerthan this distance, the judgment of which one of adjacent virtual gridpoints 5 is the center of a vector of the information dot 3.

For example, for information dots 3, as shown in FIG. 8A, when arrangingI₁ to I₁₆ from the center of the block in clockwise direction, the griddistance is 0.5 mm; 2 bits×16=32 bits may be expressed in 2 mm×2 mm.

Additionally, there can be provided sub-blocks in a block, which haveindependent information content, and are not affected by otherinformation content. FIG. 8B illustrates these sub-blocks. Sub-blocks[I₁, I₂, I₃, I₄], [I₅, I₆, I₇, I₈], [I¹⁹, I₁₀, I₁₁, I₁₂], [I₁₃, I₁₄,I₁₅, I₁₆] are each composed of four information dots 3, and each lay outindependent data (3 bits×4=12 bits) in the information dots 3. In thisway, having sub-blocks makes an error check easier per each sub-block.

Vector directions of information dots 3 (rotation direction) arepreferably set evenly for each 30-90 degrees.

FIG. 9 is an example showing an information dot 3 and a bit display ofdata defined therein and showing another embodiment.

If two types of information dots 3, long and short distance from avirtual grid point 5 surrounded by reference grid point dots 4 are used,and vector directions are eight directions, four bits can be expressed.Here, the long distance of information dots 3 is preferably about 25-30%of the gap between adjacent virtual grid points 5. The short distance ofinformation dots 3 is preferably about 15-20% of the gap betweenadjacent virtual grid points 5. However, a distance between the centersof long and short information dots 3 is preferably longer than thediameter of these dots.

The information dot 3 surrounded by four reference grid point dots 4 ispreferably one dot, taking into account the visual quality. However, ifvisual quality is disregarded and information amount should beincreased, one bit may be allocated to one vector and an information dot3 may be expressed with a plurality of dots, thereby includingvoluminous information. For example, in eight direction concentricvectors, an information dot 3 surrounded by four grid dots 4 can express2⁸ pieces of information; 16 information dots in one block accounts for2¹²⁸.

FIGS. 10A to 10C are examples of information dots and bit displays ofdata defined therein. Particularly, FIG. 10A is a diagram of disposingtwo dots, FIG. 10B is a diagram of disposing four dots, and FIG. 10C isa diagram of disposing five dots.

FIGS. 11A to 11D are modification examples of a dot pattern.Particularly, FIG. 11A is a schematic view of six information dotarrangement, FIG. 11B is a schematic view of nine information dotarrangement, FIG. 11C is a schematic view of 12 information dotarrangement, and FIG. 11D is a schematic view of 36 information dotarrangement.

The dot patterns 1 shown in FIGS. 6 and 8A to 8B illustrate exampleswhere 16 (4×4) information dots 3 are arranged in one block. However,this information dot 3 is not limited to 16-dot arrangement, and canvary. For example, depending on the size of required information amountand the resolution of a camera, six information dots 3 (2×3) may bearranged in one block (FIG. 11A), nine information dots 3 (3×3) may bearranged in one block (FIG. 11B), 12 information dots 3 (3×4) may bearranged in one block (FIG. 11C) , or 36 information dots 3 may bearranged in one block (FIG. 11D).

Further, a method for computing XY coordinate values usingabove-described dot patterns is described using FIGS. 50A and 50B.

When dot pattern 1 is retrieved as image data by a camera, aftercomputing XY coordinate values at the location of key dot 2 as arepresentative point of information, XY coordinate values at the centerof the imaging area is computed by complementing the coordinate values,based on the orientation of the dot pattern 1 obtained from the key dot2, increment of XY coordinate values at an adjacent representativepoint, and the distance from the center of the imaging area to the keydot 2 for which XY coordinate values are calculated.

Alternatively, when a block of a dot pattern 1 is retrieved as imagedata by a camera, in a region where the same data is defined or in aregion where XY coordinate values are defined, the dot pattern 1 is readwithin a minimum area from the center of the imaging area of the camerato thereby compute data at the location of the center of the imagingarea, by starting to read from an information dot 3 in vicinity of thecenter of the imaging area and sequentially reading information dots 3until information dots 3 equivalent to one block are read.

FIG. 50A illustrates an order for inputting information dots equivalentto one block within a minimum area from the center of the imaging areaof a camera. 4×4 rows=16 information dots are inputted in clockwisedirection.

FIG. 50B is an explanatory view illustrating the method for reading adot pattern and computing XY coordinate values.

As shown in FIG. 50B, XY coordinate values to be calculated are XYcoordinate values of a block where the center of the imaging area of thecamera exists. If the XY coordinate values are defined as +1 incrementin X direction (rightward) and Y direction (upward) per block,information dots input from other blocks should be calibrated. It shouldbe noted that K₈ K₇ K₆ K₅ (i₁₆ i₁₅ i₁₄ i₁₃ i₁₂ i₁₁ i₁₀ i₉) whichrepresent X coordinate values and K₄ K₃ K₂ K₁ (i₈ i₇ i₆ i₅ i₄ i₃ i₂ i₁)which represent Y coordinate values are subject to calibration; K₁₆-K₉(i₃₂-i₁₇) are the same values in any blocks and not needed to becalibrated.

These calculations are solved by the following equations (1)-(16). If acalculation in brackets ([ ]) produces a carry, it will be assumed notto affect a bit sequence before brackets ([ ]). K is information dot Iexcluding error check bits.

(1) When ₁₁I₁₁ is the starting point (i.e., center of the imaging areaof a camera),

X coordinates=₁₁K₈·₁₁K₇·₁₁K₆·₂₁K₅

Y coordinates=₁₂K₄·₁₂K₃·₁₂K₂·[₂₂ K₁+1].

(2) When ₁₁I₁₅ is the starting point (i.e., center of the imaging areaof a camera),

X coordinates=₁₂K₈·₁₂K₇·₁₂K₆·₂₂K₅−1

Y coordinates=₁₂K₄·₁₂K₃·₁₂K₂·[₂₂K₁+1].

(3) When ₁₂I₃ is the starting point (i.e., center of the imaging area ofa camera),

X coordinates=₁₂K₈·₁₂K₇·₁₂K₆·₂₂K₅

Y coordinates=₁₂K₄·₁₂K₃·₁₂K₂·[₂₂K₁+1].

(4) When ₁₂I₇ is the starting point (i.e., center of the imaging area ofa camera),

X coordinates=₁₂K₈·₁₂K₇·₁₂K₆·₂₂K₅

Y coordinates=₁₂K₄·₁₂K₃·₁₂K₂·[₂₂K₁+1].

(5) When ₁₁I₁₂ is the starting point (i.e., center of the imaging areaof a camera),

X coordinates=₁₁K₈·₁₁K₇·₂₁K₆·₂₁K₅

Y coordinates=₁₂K₄·₁₂K₃·[₂₂K_(2·) ₂₂K₁+1].

(6) When ₁₁I₁₆ is the starting point (i.e., center of the imaging areaof a camera),

X coordinates=₁₂K₈·₁₂K₇·₂₂K_(6·) ₂₂K₅−1

Y coordinates=₁₂K_(4·) ₁₂K₃·[₁₂K₂·₂₂K₁+1].

(7) When ₁₂I₄ is the starting point (i.e., center of the imaging area ofa camera),

X coordinates=₁₁K₈·₁₂K₇·₂₂K₆·₂₂K₅

Y coordinates=₁₂K₄·₁₂K₃·[₂₂K₂·₂₂K₁+1].

(8) When ₁₂I₈ is the starting point (i.e., center of the imaging area ofa camera),

X coordinates=₁₂K₈·₁₂K₇·₂₂K₆·₂₂K₅

Y coordinates=₁₂K₄·₁₂K₃·[₂₂K₂·₂₂K₁+1].

(9) When ₂₁I₉ is the starting point (i.e., center of the imaging area ofa camera),

X coordinates=₁₁K₈·₂₁K₇·₂₁K₆·₂₁K₅

Y coordinates=₁₂K₄·[₂₂K₃·₂₂K₂·₂₂K₁+1]−1.

(10) When ₂₁I₁₃ is the starting point (i.e., center of the imaging areaof a camera),

X coordinates=₁₂K₈·₂₂K₇·₂₂K₆·₂₁K₅−1

Y coordinates=₁₂K₄·[₂₂K_(3·) ₂₂K_(2·) ₂₂K₁+1]−1.

(11) When ₂₂I₁ is the starting point (i.e., center of the imaging areaof a camera),

X coordinates=₁₂K₈·₂₂K₇·₂₂K₆·₂₂K₅

Y coordinates=₁₂K₄·[₂₂K₃·₂₂K₂·₂₂K₁+1]−1.

(12) When ₂₂I₅ is the starting point (i.e., center of the imaging areaof a camera),

X coordinates=₁₂K₈·₂₂K₇·₂₂K₆·₂₂K₅

Y coordinates=₁₂K₄·[₂₂K₃·₂₂K₂·₂₂K₁+1]−1.

(13) When ₂₁I₁₀ is the starting point (i.e., center of the imaging areaof a camera),

X coordinates=₂₁K₈·₂₁K₇·₂₁K₆·₂₁K₅

Y coordinates=₂₂K₄·₂₂K₃·₂₂K₂·₂₂K₁.

(14) When ₂₁I₁₄ is the starting point (i.e., center of the imaging areaof a camera),

X coordinates=₂₂K₈·₂₂K₇·₂₂K₆·₂₂K₅−1

Y coordinates=₂₂K₄·₂₂K₃·₂₂K₂·₂₂K₁.

(15) When ₂₂I₂ is the starting point (i.e., center of the imaging areaof a camera),

X coordinates=₂₂K₈·₂₂K₇·₂₂K₆·₂₂K₅

Y coordinates=₂₂K₄·₂₂K₃·₂₂K₂·₂₂K₁.

(16) When ₂₂I₆ is the starting point (i.e., center of the imaging areaof a camera),

X coordinates=₂₂K₈·₂₂K₇·₂₂K₆·₂₂K₅

Y coordinates=₂₂K₄·₂₂K₃·₂₂K₂·₂₂K₁.

When an error occurs with an information dot 3 while retrieving the dotpattern 1 as image data by a camera, it is possible to read the dotpattern 1 within a minimum area from the center of the imaging area ofthe camera by reading an information dot 3 which is equivalent and mostadjacent to the above information dot 3 to correct the error.

The above-described information retrieving method may be used to realizea tablet, digitizer, and input interface using XY coordinates. Forexample, a tablet or a digitizer inputs XY coordinate values of a dotpattern 1, after superimposing a transparent sheet on which a dotpattern 2 is printed on a subject and capturing the image by a camera.

FIGS. 51A to 52 are diagrams showing a specific example of a dot patterndefining XY coordinates.

As shown in FIG. 51A, four dot patterns (1)-(4) are formed. Dot codeformats for each dot pattern are shown in FIG. 51B. That is, C₀-C₇ meanY coordinates, C₈-C₁₅ mean X coordinates, C₁₆-C₂₀ mean operation codes,C₂₁-C₂₉ mean content/application codes, and C₃₀-C₃₁ mean parities,respectively. Operation codes and content/application codes are codedinformation about card content or coded card operations.

Here, if an X coordinate value of the dot pattern (1) is 10 and a Ycoordinate value is 20, X coordinate and Y coordinate values of dotpatterns (2)-(4) become the values shown in FIG. 51A. Moreover, if anoperation code is 10 and a content/application code value is 100,formats of dot patterns (1)-(4) become those shown in FIG. 51B.

FIG. 52 is a diagram expressing the values shown in FIG. 51Bspecifically in a dot pattern.

As described before, FIG. 12 is a diagram illustrating a touch panelstructure for recognition of coordinates.

FIGS. 13A and 13B are diagrams illustrating a method for computing alocation touched by a fingertip of a player/operator (touch location).

It is assumed that, in a touch panel (coordinate recognition unit)coordinate system, coordinates of a central position of a camera(imaging unit) are (X_(s), Y_(s)).

It is also assumed that a central position of imaging of a card imagedby the camera expressed by the card coordinate system is (x_(s), y_(s)).

At the same time, an angle between Y direction in the touch panelcoordinate system and y direction in the card coordinate system is θ.

In such case, the touch location by the fingertip of the player/operatoras expressed in the touch panel coordinate system is (X_(t), Y_(t)).

Here, the touch location in the card coordinate system is expressed bythe following equation:

$\begin{Bmatrix}x_{t} \\y_{t}\end{Bmatrix} = {\begin{Bmatrix}x_{s} \\y_{s}\end{Bmatrix} + {\begin{Bmatrix}{\cos \; \theta} & {\sin \; \theta} \\{{- \sin}\; \theta} & {\cos \; \theta}\end{Bmatrix}\begin{Bmatrix}{X_{t} - X_{s}} \\{Y_{t} - Y_{s}}\end{Bmatrix}}}$

By performing such arithmetic processing, it is possible to recognizewhich part of the print on the card surface is touched by a fingertip,regardless of the orientation of the card placed on the surface of thetouch panel.

It should be noted that although the case in which a card surface istouched by a fingertip of a player/operator is explained in FIG. 13A,this may be done by a touch pen, etc.

FIGS. 14A and 14B are explanatory diagrams illustrating a modificationexample of this embodiment.

This touch panel chassis is characterized by having a plurality ofimaging openings. In the same way as the one shown in FIG. 1, in thetouch panel chassis, a camera is disposed corresponding to each imagingopening, in a state capable to image the direction of the correspondingopening. In FIG. 14A, if a card is placed on any of the imaging openingson the surface on the touch panel, the corresponding camera images a dotpattern on the back surface of the card. As a result, a processingcorresponding to each dot pattern at each imaging opening is performed.That is, the dot pattern is analyzed from the captured image, andcorresponding sound, image, and motion picture are output.

In FIG. 14B, a plurality of imaging openings (in this example, nine) aredisposed such that the back surface of a card is able to be imaged,regardless of a position of the card placed on the surface of the touchpanel. Such positioning of the imaging openings allows imaging of a dotpattern on the back surface of a card regardless of the location of thecard placed on the surface of the touch panel, without having a useraware thereof.

As such, according to this embodiment, recognition of a medium such as acard placed on the surface of a touch panel as the dot pattern printedon the back surface thereof, as well as recognition of a touch by aplayer, are enabled. Then, a process corresponding to the feature of thecard can be performed by calculating which part of the card placed onthe touch panel is touched based on the results of both recognitions.Therefore, it is possible to make input instructions tailored torespective features of a game or other information processing devices,simply by preparing a card on which a region for touch operation isprinted.

FIG. 15 is a perspective view showing an overview of a stage chassis inanother embodiment of the invention.

As shown in FIG. 15, the stage chassis has a display in front of a touchpanel (stage surface). The game progress varies according to apositioning of a card, a touch by a fingertip of a player on the touchpanel (stage surface), or a touch by a fingertip on the surface of thecard placed on the touch panel (stage surface). Accordingly, images ormotion pictures shown on the display also change.

FIG. 16 is a perspective view illustrating another embodiment of thetouch panel chassis (game device) in this embodiment, which has adisplay on right side of the stage surface. In this way, a displayconfigured as part of a touch panel surface of a stage surface permits adisplay of motion pictures, scores, or the like in line with progress ofthe game. Further, in FIG. 16, even though a card is placed in a displayregion, a dot pattern on the back surface of the card cannot berecognized; the display portion also has the touch panel function; thus,icons and buttons displayed on the display can be directly touched andcontrolled by a player.

Inner structure of this stage chassis is as shown in FIGS. 17A and 17B.In this embodiment, if a card on which a dot pattern is printed isplaced on a touch panel (stage surface), infrared irradiation lightirradiated from IRLED irradiates the whole back surface of the touchpanel via a reflector on a frame. The infrared irradiation lightreflected by the back surface of the card is captured by a camera.

When a sensor unit and a micro processing unit (MPU) read a dot patternprinted on the card, the dot pattern is converted into code values, andimages or motion pictures corresponding to the code values are displayedon a display device.

Additionally, cross-section structure of the stage surface on the uppersurface of this stage chassis is the structure shown in FIGS. 53A and53B.

As shown in FIG. 53A, the stage surface is a layered structure wherenon-carbon ink is applied on the upper surface of the transparent glassplate. Applied on the upper surface of the glass plate is white ink.Further on the white ink, an image is drawn with CMYK non-carbon ink.The white ink and non-carbon ink are ink which transmits infrared rays.The dot pattern printed on the back surface of a card placed on thestage surface is printed with carbon ink which has infrared rayabsorption characteristics. When infrared rays are irradiated from thelower surface of the stage surface, the infrared rays are transmittedthrough non-carbon ink portion and absorbed at the dot pattern portionon the back surface of the card. Therefore, when the reflected light isimaged, only the dot pattern portion is imaged as black.

Due to the white ink applied on the upper surface of the glass plate, animage printed on a layer above the white ink layer stands out.

Also, as shown in FIG. 53B, a transparent sheet on which an image isprinted with white and CMYK non-carbon inks may be removably attached onthe upper surface of the glass plate.

In the present invention, a transparent plate other than a glass plate,such as an acrylic plate, may be used.

FIGS. 18 and 19 illustrate, in another stage chassis of this embodiment,a stage chassis characterized by a video displayed on a touch panel(stage surface).

This embodiment features a camera (imaging unit) and a projector as aprojection unit disposed on the side of the space under the touch panel(space under the stage). The projector controls images or motionpictures projected on the stage surface based on code values orcoordinate values of a dot pattern obtained from a captured image of thecamera.

In this embodiment, if a card on which a dot pattern is printed isplaced on a touch panel (stage surface), for example, infraredirradiation light irradiated from IRLED irradiates the entire lowersurface of the touch panel via a frame-shaped reflector.

Infrared irradiation light reflected by the back surface of the card isfurther reflected by a mirror and captured by the camera. At this time,the projector projects an image or motion pictures on the lower surfaceof the stage via a mirror.

After a sensor unit and a micro processing unit (MPU) read the dotpattern printed on the card and convert the dot pattern into codevalues, the projector projects images or motion pictures correspondingto the code values.

In this way, as well as images or motion pictures are projected by theprojector from the lower surface of the stage surface, the images andmotion pictures projected are controlled by the card on which a dotpattern is printed placed on the stage surface.

Even in such system where a projector is provided, images and motionpictures displayed on the stage surface may be controlled by apositioning of the card on the touch panel. Also, for example, icons forplayback, fast-forward, rewind and the like may be printed on thesurface of the card, and motion pictures projected from below the touchpanel (below stage) may be controlled by touching the icon region with afinger (see FIGS. 38A and 38B).

FIGS. 20 to 23 are diagrams explaining a dot pattern used on a card usedfor the stage chassis illustrated in FIGS. 15 to 19.

It should be noted that the basic algorithm of this dot pattern isalmost the same as the one described in FIGS. 4-11D, but is different inthe facts that only one dot pattern for representing a single code isprinted and a direction dot which indicates a direction of the dotpattern exists.

FIGS. 20 and 21 are explanatory diagrams showing a relationship among adot pattern, a code value, and an identifier.

As shown in FIG. 20, the dot pattern is a dot pattern constituted by 3×3block regions and divided into C₁₋₀-C₁₇₋₁₆ blocks. FIG. 21 shows a dotcode format of each region.

As shown in FIG. 21, C₀-C₅ are operation codes, C₆-C₁₅ arecontent/application codes, C₁₆-C₁₇ are parities.

In FIG. 22, block directions of the dot pattern illustrated in FIGS.6-11D, a dot pattern having blocks constituted by 3×3=9 grid regions,are defined by changing, within a specific grid region (directionregion), the orientation of only information dot 3 from the orientationsof other grid regions (direction region).

That is, in FIG. 22, information dots 3 are arranged in horizontal andvertical directions from the center in the lower left grid region 34A,central grid region 34B, and lower left grid region 34C. In other gridregions, information dots 3 are arranged diagonally from the center.Since the grid regions 34A, 34B and 34C are arranged in this way,according to a triangle shaped by connecting these grid regions, that isthe apex 34B in relation to the base (34A to 34C), the blocks arerecognized as facing upward.

In this way, arrangement relationship of grid regions 34A, 34B, and 34C,where arrangement directions of information dots 3 are changed(information dots are arranged in horizontal and vertical directionsfrom the center), (in this example, triangle) can define the directionof the block. Therefore, since information dots 3 can be arranged in allgrid regions of blocks, information dots 3 can be arranged in all gridregions without sacrificing grid, regions for key dots.

FIG. 23 is a diagram showing an arrangement of information dots 3corresponding to FIG. 22.

When printing a dot pattern on the back surface of a card, the gapbetween grids are preferably about 15 mm, and the size of a dot ispreferably about 15% of the gap between dots. Thus, 2 mm to 2.5 mm ispreferable without limitation for these. Upon imaging, the resolution ofthe gap between dots is preferably 14 pixels or above.

FIGS. 24A and 24B are diagrams illustrating a method for computing alocation touched by a fingertip of a player/operator (touch location).

It is assumed that W represents the width of a card, H represents theheight of the card, and the coordinates of the central position of thecard in touch panel coordinate system are (X_(c), Y_(c)). Also, it isassumed that θ represents the card's rotation angle, that is, the anglebetween Y direction of the touch panel coordinate system and y directionof the card's coordinate system.

In this case, a touch location by a fingertip of a player/operator isassumed as (X_(t), Y_(t)), when described in the touch panel coordinatesystem. The touch location (x_(t), y_(t)) in the card's coordinatesystem is expressed by the following equation:

$\begin{Bmatrix}x_{t} \\y_{t}\end{Bmatrix} = {\begin{Bmatrix}\frac{W}{2} \\\frac{H}{2}\end{Bmatrix} + {\begin{Bmatrix}{\cos \; \theta} & {\sin \; \theta} \\{{- \sin}\; \theta} & {\cos \; \theta}\end{Bmatrix}\begin{Bmatrix}{X_{t} - X_{c}} \\{Y_{t} - Y_{c}}\end{Bmatrix}}}$

By performing such arithmetic processing, the portion of a printing onthe surface of a card touched by a finger can be recognized, regardlessof the orientation of the card placed on the touch panel (stage).

Although the case the touch on the card surface is done by a fingertipof a player/operator is described in FIG. 24A, this may be performed bya touch pen, etc. as a matter of course.

FIGS. 25A and 25B are diagrams illustrating a coordinate recognitionunit (touch panel) having a notch or curved side wall portion on part ofthe peripheral wall portion of the panel, in order to retract the touchpanel or a medium on the stage surface from the panel surface.

In FIG. 25A, on one side of the peripheral wall S1, one or a pluralityof infrared irradiating elements as an emitting portion and one or aplurality of light-receiving elements as a receiving portion areadjacently disposed one after the other. On sides S2 and S3 adjacent tothe one side of the peripheral wall S1, infrared irradiation elements orlight-receiving elements are disposed respectively. XY coordinates of afinger on a touch panel or a stage can be recognized based on the factthat the light-receiving elements on the opposed surface do not receivethe infrared light as irradiation light irradiated from the infraredirradiating elements and blocked by an operator's finger directlytouching the touch panel or the stage, or a player/operator's fingertouching a medium on the touch panel or the stage.

Here, a side S4 opposed to the one side S1 is configured as a notchportion. A medium such as a card can be retracted by a finger from thetouch panel or the stage surface through this notch portion.

It should be noted that although in the example of FIGS. 25A and 25Bdiagrams of a state in which a finger of a player touching the touchpanel or the stage surface are illustrated, the finger can be replacedwith other three-dimensional object such as a touch pen or a figure.

FIG. 25B is a diagram illustrating a coordinate recognition unit of thetouch panel, embedded in the peripheral wall portion of the touch panelor the stage. The coordinate recognition unit (touch panel) has a sidewall (curved side wall portion SW) curved from the touch panel or thestage surface in order to retract a medium on the touch panel or thestage surface from the touch panel surface.

Infrared irradiation elements and light-receiving elements, whichreceive the infrared light, are disposed on the peripheral wall portion(peripheral wall) as a coordinate recognition unit.

As such, by making part of the side wall a curved side wall portion SWcurved from the touch panel surface, removal of the card becomes veryeasy.

In FIGS. 26A and 26B, a card loading slot is provided on a side of atouch panel chassis. A card having cords printed on the back surface ofwhich as a dot pattern and key buttons such as alphabet buttons printedon the front surface of which can be loaded from the card loading slot.An imaging opening is provided on the touch panel surface side of thetouch panel chassis so that the dot pattern printed on the back surfaceof the card loaded from the loading slot can be read by an imaging unit(camera) from inside the chassis.

That is, the control unit can recognize which region printed on thesurface of the card is touched by recognizing codes read from a dotpattern on the back surface of the card and the position of XYcoordinates on the surface of the touch panel touched by an operator orplayer, or a user.

In this way, according to the touch panel chassis shown in FIGS. 26A and26B, since a card can be inserted of ejected from the card loading slot,the card can be removed from the touch panel without having a notchportion.

As shown in FIGS. 26A and 26B, as a card loaded from the card loadingslot is assuredly positioned on the touch panel surface, XY coordinatesystem on the surface of the card can perfectly match XY coordinatesystem recognized by the touch panel. A location touched by a finger ora medium on the card is easily recognized without performing acomplicated calculation.

Although an alphabet key top layout which is similar to a keyboard isprinted on the surface of the card as a pattern, it is not limited toalphabet; an icon, photograph, illustration and the like may be printedon divided regions.

Information output device in the present invention can be used for avariety of usages, by changing the card content. FIGS. 27 to 46B arediagrams illustrating the specific examples of cards.

Any and all cards described below are used by being placed on the touchpanel chassis or the stage chassis.

When a card is placed by an operator/player, the dot pattern is readfrom a camera in the touch panel chassis or the stage chassis, thencentral processing unit of the camera or a computer converts the dotpattern into code values. As a result, the card content is recognized.Moreover, an icon, a picture, or the like printed on the card surface istouched by an operator/player, as described above, a location touched isrecognized and a process corresponding to the instruction of the icon orthe content of the picture or the like is performed.

FIG. 27 is a diagram when the card is used as a membership card.

After touching the “PASSWORD” printed lower left of the card, anoperator enters the password using a numeric keypad. Next, the operatortouches a photograph of a face printed upper left of the card to displayregistered personal information on a display. Further, entering andleaving the room are possible by touching “ENTERING ROOM” upon enteringthe room and “LEAVING ROOM” upon leaving the room.

FIGS. 28A and 28B are diagrams when the card is used as an employee IDcard.

An operator enters a password by touching numbers printed lower left ofthe card and then “Enter.” Next, a registered personal information isdisplayed on a display device by touching a photograph of a face printedlower left of the card.

The back surface of the card constitutes a time card. For example,processing for arriving and leaving office is performed, by touching“ARRIVING” upon arrival of the office and touching “LEAVING” uponleaving the office.

FIG. 29 is a diagram when the card is used as a card for timemanagement.

The card is primarily used by a manager for managing the attendancestates of employees. When an operator touches “ATTENDANCE INFORMATION,”information including arriving time and leaving time of each employee isdisplayed on a display device. Further, if the operator touches“EKPLOYEE INFORMATION,” more detailed information of the employee isdisplayed. Likewise, if the operator touches icons, a variety ofinformation may be displayed on the display device.

FIG. 30 is a diagram when the card is used as a calculator.

When an operator touches a number, symbol of calculation or the likeprinted on the card surface, the number, etc. and the calculationresults are displayed.

FIG. 31 is a diagram when the card is used as a card for movie viewing.

Upper half of the card displays a picture of one scene of a movie,photograph, or the like. When an operator touches “PLAY,” a movie isplayed on the display device. When “STOP” is clicked, playback stops.When “MUTE” is touched, sound is muted. Further, when the operator wantsto change sound volume, operator may touch “UP” or “DOWN.” When theoperator wants to rewind, he or she may touches “REWIND,” and when theoperator wants to fast-forward, he or she mat touches “FORWARD.”

FIG. 32 is a diagram when the card is used as a card for Web browsing.

Pictures of cars are displayed on the upper portion through centerportion. When one of the pictures is touched by an operator, a Web pagerelated to the displayed picture is accessed. When the operator wants toproceed to the page following the page displayed, he or she touches“NEXT.” When the operator wants to return to the previous page, he orshe touches “RETURN.” When the operator wants to change the size of thephotograph or the like on the page, he or she touches “ZOOM IN/ZOOMOUT.” When the operator wants to scroll the screen, he or she touchesany one of “UP,” “DOWN,” “LEFT,” or “RIGHT.” When ending the Webbrowsing, the operator touches “End.”

FIGS. 33A and 33B are diagrams when the card is used as a card forviewing 3D objects.

The card shown in FIG. 33A is placed on the upper panel surface of thetouch panel chassis, 3D-CG image of an object (three dimensional video)is displayed. When an operator touches a photograph of the object, adescription about the object is displayed. When the “UP” symbol istouched, as shown in FIG. 33B, a video of the object in a way whenlooked up from below is displayed. When “STANDARD VIEWPOINT” symbol istouched, a standard video is displayed. When a “DOWN” symbol is touched,a video of the object in a way when looked down from above is displayed.“UP” of “STANDARD WINDOW” raises the viewpoint without changingviewpoint's angle, and upper portion of the object is displayed. Whenthe “STANDARD WINDOW” symbol is touched, the center of the object isdisplayed as the center of the video. “ZOOM IN” displays an enlargedvideo in a way when the operator approaches toward the viewpointdirection, without changing viewpoint's angle. “ZOOM OUT” is thecontrary; a reduced video is displayed. When the “STANDARD SCALE” symbolis touched, the video is displayed in a standard scale. Also, as shownin FIG. 33A, when the card is rotated, the object rotates 360 degrees.

FIG. 34 is a diagram when the card is used as a patient's registrationcard.

A touch panel chassis is installed in a hospital or clinic. When anoperator places the card on the touch panel chassis, first, theoperator's personal information is recognized by the dot codes in theback surface of the card. When the operator touches “RECEPTION,”reception processing is performed. The operator touches “PAY” to payafter medical consultation, and “PRESCRIPTION” to receive aprescription.

FIGS. 35A to 35C are diagrams when the card is used as a card forshopping.

One or a plurality of touch panel chassis is installed in a shop such asa convenience store, the card shown in FIG. 35A is equipped in thevicinity of the touch panel chassis. When an operator clicks aphotograph of goods displayed in the shopping card, as shown in FIG.35B, a description of the goods is displayed in the left side of thedisplay. “SHOPPING CART” on the lower portion of the card is touched tobuy the goods displayed. Touching once orders one goods, touching twiceorders two goods. The goods ordered and the number thereof are displayedon the right side of the display. When “UP” is touched, the highlightmoves upward. When “DOWN” is touched, the highlight moves downward. Whenthe operator touches “CANCEL ONE,” the quantity of the goods highlighteddecreases by one.

After goods and the number thereof are determined, “PURCHASE” istouched. As a result, a token shown in FIG. 35C is output. The operator,on later day, brings this token to a cash register of the shop and paysfor the purchase. Then, the goods already packed are provided.

It should be mentioned that, in this embodiment, methods other than cashsuch as pre-paid cards may be used to pay.

FIG. 36 is a diagram when the card is used as an ATM card for banking.

When an operator places a card on the touch panel chassis, a dot patternon the back surface of the card is read, and information such as anaccount number is recognized. The operator enters a predeterminedpassword by touching numbers. Numbers on the card are arranged in randomto prevent the password from being detected from a finger movement by athird person. When the password is recognized as entered correctly, theoperator can perform processing such as a transfer or withdrawal.

FIG. 37 is a diagram when the card is used as an animal pictorial bookcard.

When an operator touches a picture or a photograph of an animaldisplayed on the card, a description of the animal is displayed on adisplay device. Further, when the “SOUND” symbol is clicked, the soundof the animal is output.

FIGS. 38A and 38B are diagrams when the card is used as a controller fora movie recorder.

FIG. 38A is the front surface of the card. FIG. 38B is the back surfaceof the card. When an operator places the card with FIG. 38A side up, itfunctions as a controller for a movie recorder. That is, the operator isenabled to perform operations such as movie recording, changing of soundvolume, playback, play at fast speed, or play while fast rewinding. Whenthe card is placed with the FIG. 38B side up, the operator can edit, forexample, a movie title by touching alphabets, numbers, or the like.

FIG. 39 is a diagram when the card is used as a controller for a voicerecorder. In this embodiment, the touch panel chassis is connected to avoice recorder via a USB cable, etc. When an operator touches “RECORD,”sound is started to be recorded. When “PLAY” is touched, playbackprocessing of the sound recorded in the voice recorder is performed.Likewise, when the operator touches icons such as “FORWARD,” “STOP,” or“PAUSE,” a processing corresponding to the icon is performed.

FIGS. 40A and 40B are diagrams when the card is used as a recipe card.

FIG. 40A is the front surface of the card. FIG. 40B is the back surfaceof the card. When an operator touches a photograph of an ingredient (inthis case, celery) displayed on the center portion of the surface, theeffects of the ingredient (celery) is described on the display device.When an advertisement photograph displayed on the lower portion of thecard is touched, the content of the advertisement photograph (in thiscase, electronic cooking equipment) is displayed via the Internet or asvideo. Further, when the operator touches a photograph of a serving fooddisplayed on the upper portion of FIG. 40B, a scene of arranging food ona dish is introduced on the display device. When the description portionof the ingredient displayed on the center portion is touched, theingredient is introduced. Also, when the cooking method displayed on thelower portion is touched, the cooking method of the food displayed as aphotograph on the upper portion of the card is introduced as a video onthe display device.

FIGS. 41A to 41C are diagrams illustrating a specific use example usinga booklet as a medium.

A dot pattern is superimposed and printed on the back cover of the book.As shown in FIG. 41A, when the operator touches the “START” on the upperportion of the front cover, information about the car drawn on the frontcover is displayed on the display device. “START” is printed on theupper portion of each page, and shifted page by page, as shown in FIGS.41B and 41C. Therefore, when a “START” is touched, the page open isrecognized. When a picture, a photograph, or a symbol on that page istouched, a corresponding Web page, video, or the like is displayed onthe display device.

FIG. 42 is a diagram illustrating a specific use example using anotepad-like booklet as a medium.

In this specific use example, the booklet is formed to be flippedupward.

A dot pattern is superimposed and printed on the back cover of thebooklet. The operator touches “PAGE INPUT” displayed on the touch paneland then touches a number to enter the page currently open. Whenentering of the number is completed, the operator touches “ENTER,” thentouches a picture, photograph, symbol of the page, a corresponding Webpage, video, or the like is output on the display device.

FIG. 43 is a diagram when the card is used as a questionnaire sheet.

This specific use example is a questionnaire to determine the optimumgoods for an operator. A piece of goods which is a subject for thequestionnaire is displayed on the upper portion of the card (in thiscase, moisturizer). The operator answers to the questions by touching“YES” or “NO.” The answers of the operator are displayed on the displaydevice. When the answering finishes, “DETERMINE” is touched. Theoperator touches “CANCEL” and answers once again in order to change ananswer. As a result, a cosmetic optimum for the operator and the usagethereof is introduced.

FIG. 44 is a diagram when the card is used as a card for controlling asystem.

This card is used to control a machine and the like at a factory. Forexample, an operator touches “MANUFACTURING ROBOT (A)” and touchesinstructions such as “EXCHANGE PARTS” to control a manufacturing robot.A complicated maneuvering was required to date for controlling ofmanufacturing machines and robots. However, with this method, they canbe controlled easily by preparing cards for each purpose.

FIG. 45 is a diagram when the card is used as a card for playing music.

An operator first touches any one of the instrument pictures (in thiscase, a violin, piano, and ocarina). Next, the operator touches apicture of a keyboard. As a result, sound corresponding to the touchedkey is generated in a timbre of the selected instrument. This enablesthe operator to play music. Also, by touching “RECORD” before touchingthe keyboard, the music played is recorded. Touching “PLAY” playbacksthe music played.

FIGS. 46A and 46B are a modification example of the card as a medium.This card, as a mouse card, can realize the same function as a mouse asan auxiliary input device of a general-use computer.

That is, on a surface of the mouse card, there printed icons of a rightclick button and left click button corresponding to the click buttons ofa mouse. Further, icons of scroll buttons “UP,” “DOWN,” “LEFT,” and“RIGHT” are printed to scroll the screen.

The card is provided with a mouse-pad region. The screen displayed maybe controlled by moving a fingertip within this mouse-pad region.

Further, a dot pattern is printed on the back surface of the mouse card,code values and coordinate values are patterned in a predeterminedalgorithm (described in FIGS. 4-11D).

Such mouse card can be loaded on a touch panel chassis with a loadingslot as shown in FIGS. 26A and 26B to function as an auxiliary inputdevice such as a mouse or a controller.

In this way, if a structure in which a card is fixed on the touch panelsurface is formed by equipping a loading slot, position relationsbetween the touch panel and the card is determined. Therefore, only codevalues are required as information obtained from the dot pattern on theback surface of the card.

Further, FIG. 46B shows a mouse card similar to the above-describedcard, but suited to a touch panel chassis with relatively wider stagesurface. An image displayed on the stage surface or an image displayedon other display device can be controlled by moving the mouse card up,down, left, or right.

It should be noted that specific use examples of the card or mediumplaced on the touch panel chassis or stage chassis are not limited tothe above. A variety of specific use examples may be, of course,considered.

FIG. 47 shows a standing-type touch panel chassis.

The structure of this standing-type touch panel chassis is almost thesame as the one of the touch panel shown in FIGS. 12 and 48A to 49B, yetfeatures suction openings disposed in matrix form in the vicinity of theimaging opening over the entire panel. A vacuum suction pump (not shown)is provided in the touch panel chassis, and forms a negative pressurespace in the touch panel chassis. The vacuum suction pump is activatedby an instruction signal from a control unit (CPU). When a card isplaced in the vicinity of the imaging unit, a camera provided inside theimaging opening detects a change in light, and the control unit (CPU)activates the vacuum suction pump and causes the vacuum suction pump tostart vacuum suctioning so that the back surface of the card comes inclose contact with the touch panel.

Accordingly, disposing a vacuum suction opening ensures a card to befixed on a touch panel, even with the standing-type touch panel.

FIG. 48A shows another embodiment of a touch panel (coordinaterecognition unit).

Specifically, a pair of infrared imaging devices (camera A and cameraB), which allows a stage to function as a coordinate recognition unit,is provided on both inner ends of one side of a peripheral wall of thetouch panel.

XY coordinates of a fingertip of a player/operator, a pen, or a threedimensional object on the touch panel or stage can be recognized by thecontrol unit by analyzing an image captured by these infrared imagingdevices.

Further, one side of the peripheral wall is a notch portion, whichfacilitates a card as a medium to be retracted from the stage or touchpanel.

On both sides of the cameras A and B, infrared irradiation elements areprovided so that the cameras capture reflected light of the infraredrays irradiated from the infrared irradiation elements. Since thecameras, although not shown, are able to capture this reflected light,these cameras A and B are provided with an IR filter respectively.

A retroreflection surface is configured in the inner surface of theperipheral wall, which has a feature of reflecting infrared rays in thesame direction as the incident infrared rays.

FIG. 48B shows captured images of the cameras A and B. If a fingertip isplaced on the touch panel or stage surface, the images of such part F1and F2 (fingertips) are captured as reflected light different from otherpart. Accordingly, XY coordinates of a fingertip on the touch panel orstage surface can be calculated by analyzing the images of both camerasA and B.

That is, an angle a can be computed by the recognition of the F1location based on the captured image of the camera A and an angle β canbe computed by the recognition of the F2 location based on the capturedimage of the camera B, thus, coordinate values (X, Y) can be computed.

Further, the location may be recognized by detecting the differencebetween an image when such fingertip does not exist on the touch panelor stage surface and an image when touched by a fingertip.

FIGS. 49A and 49B have a structure nearly the same as FIGS. 48A and 48B,yet are different in the fact where a notch portion is provided on upperone side of a peripheral wall in FIGS. 49A and 49B, while FIGS. 48A and48B have the notch portion on lower side thereof.

In this way, regardless of the notch portion existing in the imagefields of the cameras A and B, if a reflected image of the notch portionas an initial image is obtained in advance as a reference image, adeference can be detected from the captured image when touched by afingertip, the XY coordinates of the fingertip can be easily calculated.

INDUSTRIAL APPLICABILITY

The present invention may be used as an input instruction device for agame device whose card is placed on a stage surface thereof, or acomputer whose card has various functions.

1. An information output device comprising: a touch panel chassis havinga touch panel on at least one surface thereof; the touch panel having amedium, on which a coordinate value based on a predetermined rule and adot pattern signifying a code value are printed, placed on the touchpanel with a surface on which the dot pattern is printed facing thetouch panel; a coordinate recognition unit, disposed on a side of thetouch panel, for recognizing, as a coordinate value, a position of aplayer/operator's fingertip or a position of a pen or a threedimensional object on the medium of the touch panel; an imaging unit forimaging the dot pattern of the medium or a portion thereof from a backsurface side of the touch panel via an imaging portion disposed on apredetermined location in the touch panel chassis; a control unit forcomputing the coordinate value, the code value, and an orientationsignified by the dot pattern based on a captured image by the imagingunit, and for inputting a coordinate information from the coordinaterecognition unit of the touch panel; and an output unit for outputtingmultimedia information such as a text, figure, image, motion picture, orsound information according to an instruction from the control unit;wherein the control unit calculates where on the medium a placing of theplayer/operator's fingertip or a placing of the pen or three dimensionalobject is performed, based on the coordinate value and code value of thedot pattern printed on the medium and the orientation of the medium,predetermined location information of the imaging portion, and thecoordinate information from the coordinate recognition unit, and thecontrol unit causes the output unit to output the multimedia informationwhich differs depending on the location on the medium calculated.
 2. Theinformation output device according to claim 1, wherein the dot patternprinted on the medium has at least the code value, and the medium isfixed at a predetermined location and orientation on the touch panel,wherein the control unit calculates where on the medium a placing of theplayer/operator's fingertip, an operation, or the three dimensionalobject is performed, based on the code value of the medium and thecoordinate information from the coordinate recognition unit, and thecontrol unit causes the output unit to output the multimedia informationwhich differs depending on the location on the medium calculated.
 3. Theinformation output device according to claim 1, wherein the imagingportion in the touch panel chassis is a transmissive portion whichtransmits irradiation light from an infrared irradiation unit andreflected light thereof, and at least one or two or more of thetransmissive portions are provided.
 4. An information output device,comprising a stage chassis having a stage on at least one surfacethereof, configured to: after placing a medium, on which back surface adot pattern based on a predetermined rule is printed, on the stage withthe back surface of the medium facing the surface of the stage, read thedot pattern on the back surface of the medium placed at a certainlocation on the surface of the stage by an imaging unit disposed in aspace in the stage chassis; calculate a code value signified by the dotpattern, based on a captured image obtained from the imaging unit, andan orientation of the medium, based on a recognition result of the dotpattern; compute a location of the medium placed on the surface of thestage which is defined by XY coordinates; and output informationaccording to such computing result, wherein, on the stage, a coordinaterecognition unit for recognizing a position of a player/operator'sfingertip or a position of a pen or three dimensional object withrespect to the medium on the stage is provided.
 5. The informationoutput device according to claim 4, wherein, on the stage, a printingwith ink which transmits infrared rays is made or a sheet printed withthe same ink is removably attached.
 6. The information output deviceaccording to claim 4, wherein a projection unit for projecting a motionpicture or an image from a back surface side with respect to the stageis given, wherein the control unit controls the image or the motionpicture projected from the back surface side of the stage by theprojection unit by interlocking with a placing of the player/operator'sfingertip, a touching with the pen, or a placing of the threedimensional object recognized by the coordinate recognition unit.
 7. Theinformation output device according to claim 1, further having: aperipheral wall on a periphery of the surface of the touch panel; and anotch portion on part of the peripheral wall so that a medium on thesurface of the touch panel can be retracted from the surface of thetouch panel.
 8. The information output device according to claim 1,further having: one or a plurality of infrared irradiation elements andone or a plurality of light-receiving elements adjacently disposed oneafter another to cause the touch panel to function as a coordinaterecognition unit, wherein a location in an X direction or a Y directionon the touch panel can be recognized by a reception, by thelight-receiving elements, of reflected light of infrared lightirradiated from the infrared irradiation elements and reflected by aplayer/operator's fingertip, pen or three dimensional object placed onthe touch panel or on the medium on the touch panel; and a notch so thatthe medium on other side of the peripheral wall or on the touch panelcan be retracted from the touch panel.
 9. The information output deviceaccording to claim 1, wherein, on sides adjacent to the one side of theperipheral wall, peripheral walls are provided on which infraredirradiation elements or light-receiving elements are disposedrespectively, and the peripheral walls enable a recognition of alocation in a Y direction or an X direction on the touch panel, based onthe fact that the light-receiving elements on an opposed side do notreceive infrared light as irradiated light irradiated from the infraredirradiation elements and blocked by a player/operator's fingertip, pen,or three dimensional object placed on the touch panel or on the mediumplaced on the touch panel.
 10. The information output device accordingto claim 1, wherein a recognition of XY coordinates of aplayer/operator's fingertip, pen, or three dimensional object on thetouch panel is made possible by providing a pair of infrared imagingdevices, which allows the touch panel to function as a coordinaterecognition unit, on both inner ends of one side of a peripheral wall ofthe touch panel, and by having a control unit analyze images captured byeach of the infrared imaging devices, wherein at least one side of theperipheral wall has the notch portion so that a medium on the touchpanel can be retracted from the touch panel.
 11. The information outputdevice according to claim 1, further having a peripheral wall on aperiphery of the touch panel, embedding a coordinate recognition unit ofthe touch panel in the peripheral wall, and comprising a side wallcurved from the touch panel that a medium on the touch panel can beretracted from the touch panel.
 12. The information output deviceaccording to claim 1, further having a peripheral wall on a periphery ofthe touch panel, embedding a coordinate recognition unit of the touchpanel on the peripheral wall, and providing a card loading slot on thetouch panel so that a medium can be inserted or retracted therethrough.13. The information output device according to claim 1, wherein aselection button of the multimedia information is directly printed or asheet on which a selection button of the multimedia information isprinted is removably attached on a portion of the touch panel, and aposition of a player/operator's fingertip, pen operation, or threedimensional object in relation to the selection button is recognizedbased on the coordinate information from the coordinate recognition unitto thereby output selected multimedia information from an output unit.14. The information output device according to claim 1, wherein part ofthe touch panel is configured as a display portion which is able todisplay display information of a display unit provided on the touchpanel.
 15. The information output device according to claim 1, wherein asuction opening for absorbing a medium to the touch panel is provided,and the suction opening makes the medium in close contact with the touchpanel by forming negative pressure in the suction opening.
 16. Theinformation output device according to claim 15, wherein a negativepressure generation unit controlled by a control unit is provided in atouch panel chassis where the touch panel is provided, and the controlunit, when it recognizes a location of a medium in a vicinity of thetouch panel based on a change of a captured image captured by theimaging unit, instructs the negative pressure generation unit to vacuumsuction from the suction opening.
 17. The information output deviceaccording to claim 4, further having: a peripheral wall on a peripheryof the surface of the stage; and a notch portion on part of theperipheral wall so that a medium on the surface of the stage can beretracted from the surface of the stage.
 18. The information outputdevice according to claim 4, further having: one or a plurality ofinfrared irradiation elements and one or a plurality of light-receivingelements adjacently disposed one after another to cause the stage tofunction as a coordinate recognition unit, wherein a location in an Xdirection or a Y direction on the stage can be recognized by areception, by the light-receiving elements, of reflected light ofinfrared light irradiated from the infrared irradiation elements andreflected by a player/operator's fingertip, pen or three dimensionalobject placed on the stage or on the medium on the stage; and a notch sothat the medium on other side of the peripheral wall or on the stage canbe retracted from the stage.
 19. The information output device accordingto claim 4, wherein, on sides adjacent to the one side of the peripheralwall, peripheral walls are provided on which infrared irradiationelements or light-receiving elements are disposed respectively, and theperipheral walls enable a recognition of a location in a Y direction oran X direction on the stage, based on the fact that the light-receivingelements on an opposed side do not receive infrared light as irradiatedlight irradiated from the infrared irradiation elements and blocked by aplayer/operator's fingertip, pen, or three dimensional object placed onthe stage or on the medium placed on the stage.
 20. The informationoutput device according to claim 4, wherein a recognition of XYcoordinates of a player/operator's fingertip, pen, or three dimensionalobject on the stage is made possible by providing a pair of infraredimaging devices, which allows the stage to function as a coordinaterecognition unit, on both inner ends of one side of a peripheral wall ofthe stage, and by having a control unit analyze images captured by eachof the infrared imaging devices, wherein at least one side of theperipheral wall has the notch portion so that a medium on the stage canbe retracted from the stage.
 21. The information output device accordingto claim 4, further having a peripheral wall on a periphery of thestage, embedding a coordinate recognition unit of the stage in theperipheral wall, and comprising a side wall curved from the stage sothat a medium on the stage can be retracted from the stage.
 22. Theinformation output device according to claim 4, further having aperipheral wall on a periphery of the stage, embedding a coordinaterecognition unit of the stage on the peripheral wall, and providing acard loading slot on the stage so that a medium can be inserted orretracted therethrough.
 23. The information output device according toclaim 4, wherein a selection button of the multimedia information isdirectly printed or a sheet on which a selection button of themultimedia information is printed is removably attached on a portion ofthe stage, and a position of a player/operator's fingertip, penoperation, or three dimensional object in relation to the selectionbutton is recognized based on the coordinate information from thecoordinate recognition unit to thereby output selected multimediainformation from an output unit.
 24. The information output deviceaccording to claim 4, wherein part of the stage is configured as adisplay portion which is able to display display information of adisplay unit provided the stage.